For getting around Fraser's Hill, your own car is the best option. However there is no petrol station up in Fraser's Hill so remember to fill your tank before going uphill. Should you get caught without sufficient petrol in Fraser's Hill, ask the locals and they may sell some petrol to you in 1 litre bottles.
Most distances are, however, walkable if you're not in hurry and don't mind going up/downhill or taking the trails through the jungle.